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Over the past few years our office has been heavily involved in assisting many 
departments in collecting student evaluation data on their faculty; and in 

most cases the primary purpose is to help committees make recommendations for 
personnel decisions. It seems appropriate, if not absolutely necessary, that 

we state as clearly as possible some of our assumptions about student evaluations 
in relationship to personnel decisions and give some recommendations and guide- 
lines for how this data should be used. 


We believe that personnel decisions; to the extent that they seriously affect 
the lives of individuals, to the extent that they demonstrate to the faculty 
the priorities, values and orientation of the institution, and to the extent 
that they affect the very quality of the university community in its teaching, 
research and service roles; are among the most important decisions made at 
Concordia. It seems imperative then that these decisions be based on the best 
information available and reflect a careful assessment of individual strengths 
and institutional needs. 


Student evaluations represent one important and essential part of the data which 
should be considered in making decisions with respect to teaching, which is one 
of the major responsibilities of most, if not all, of the faculty. 

Since students are the only ones who come into contact with the professor on a 
class to class basis, do the required work and take the exams, they are 
probably the best judges of how well the professor has been teaching. They 

can assess the clarity and organization of presentations, the atmosphere and 
rapport in the classroom, the degree of motivation and stimulation and, 

probably as well as any other measuring device we have, the amount they have 
learned and its significance for them. 


However, we also believe that faculty members, in their teaching role, do many 
other things which might be better assessed in ways other than questionnaires 
and by persons other than students. Professors design courses, select materials, 
develop methods of evaluation and set standards of performance, etc.. While 
students may comment from their perspective on some or all of these, it would 


also be appropriate to have peers assess 
the design of courses, the appropriate- 
ness of the materials for the particular 
objectives of the course or program, the 
level of the material, the variety of 
methods and standards of evaluation, the 
currency of the content and materials, 
the quality of the reading‘lists for the 
nature of the course and the level of 
students, etc.. In general, colleagues 
are probably better able to assess the 
"content" of the course and its "design" 
while the students can assess its "pro- 
cess"; how it was offered or delivered. 


Another professional responsibility we 
all have as teachers is to be contin- 
ually working to examine and improve 

our performance. Any information on 
activities a professor has undertaken 

to develop and improve as a teacher 
should be considered in assessing 
"teaching"; and this information is 
probably best, if not only, available 
from the professor himself in the form 
of a "self-evaluation" report. 
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In summary then, we believe it is impor- 
tant to assess all aspects of a prof- 
essor's performance as a teacher (course 
designer, deliverer, evaluator, advisor 
etc..) and to collect the appropriate 
information from the appropriate source. 
We believe that students are one essen- 
tial source of information on teaching, 
but certainly should not be the only 
one. 


It is clear that the final contractual 
recommendations for any individual 
professor reflect an assessment of his 
or her contribution across several 
different areas: teaching, research 
and scholarship, service and adminis-— 
tration. The assessment of the teaching 
itself should include the analysis of 
different types of data from different 
sources. How these various pieces of 
information are weighted, and what 
place teaching has in the overall 
recommendation reflects the priorities, 
policies or politics of individual 
departments, faculties, and the insti- 
tution itself. 


In another newsletter (November 1978) 
we have proposed the concept of a 
"teaching protfolio or dossier". 


A portfolio would include all appropriate 
information and documentation on my 

work as a professor. It might include 
course outlines, exams, samples of 
students work, video tapes of my teaching, 
report on my activities to evaluate, 
change or improve my course etc. The list 
could go on but fundamentally it is the 
type of information that might be assessed 
by people other than students. 


In the remainder of this article, I would 
like to present some suggestions for 
analyzing and interpreting only one part 
of such a protfolio - the results of 
student evaluation questionnaires. 


It has been our experience that when 
personnel committees are considering 
evaluation results they are trying to 
place professors in one of only two or 
three categories: acceptable/unaccepta- 
ble; outstanding/satisfactory/unsatis- 
factory. For all practical purposes 
much finer distinctions are rarely 
necessary. And rather than using some 
absolute standard these decisions are 
almost always made in the context of 
some given group of people - usually a 
particular department. 


In order to provide some context for 
interpreting the numbers on evaluation 
print-outs we have tried to provide 
various "response profile groups” - all 
the courses in your department taken 
together, or the courses grouped by level 
or by the number of students enrolled. 

We sould welcome suggestions as to other 
groups that might be formed. In general 
we are trying to provide for such ques- 
tions as: "in the context of other 
courses like this one (eg. other math 
courses, other large math classes, other 
600 level math courses) is this teacher 
outstanding/average/unacceptable?" 
Departmental personnel committees are 
probably best able to make these decisions. 
They know the nature of the courses and 
the particular teaching situation in 
their department. 


It might be appropriate to consider other 
contexts as well, eg. required introductory 
courses may be responded to differently 
from elective courses. In fairness to 
individual faculty members it is probably 
wise to consider each professor in the 
various contexts possible. It might 

well be that an individual's evaluations 
indicate success (positive student response) 
in one context but not in another. This 
should certainly be part of the assess- 
ment and recommendation, and probably 

part of the departmental planning consi- 
derations when assigning new teaching 
responsibilities. 


Most questionnaires contain at least one 
overall summary question rating the 
teacher's effectiveness, and maybe others 
on the course, and the amount learned. 
These questions are the best ones to use 
in assessing general teaching effective- 
ness. Many of the other questions, which 
serve to clarify, expand, and explain 
these general ratings, are more likely to 
be subject to individual variation as 

a result of the particular objectives 

of a course, different teaching styles 

or methods etc.. While these other 
questions give insight into particular 
overall ratings and may temper individual 
contractual recommendations, and as well 
as providing useful information for 
possible improvements for the individual 
faculty members; we would suggest primary 
consideration be given to these overall 
summary type questions. 


There are many variables which may 
influence student evaluations and these 
should be considered by personnel committees 
interested in making fair, just and 
reasoned recommendations on teaching 
effectiveness. Professors who are 
experimenting with new teaching methods 
or new material, professors who have 
redesigned their course; or professors 
who are teaching a course for the first 
time, or who are being evaluated in a 
particular course for the first time; 
any of these professors may receive 
atypical evaluations. 


Personnel committees, when making major 

career decisions about faculty members, 

have the serious responsibility - 

1) to interpret the evaluation results 
judiciously 


2) to seek whatever additional information 
seems appropriate and necessary to 


understand. The circumstances surroun- 
ding any particular course (self eval- 
uations by professors of each of their 
courses are useful in this regard) 

3) to look at evaluations from previous 
years and —- 

4) to consider any important variables 
surrounding the teaching of a course 
which might influence its assessment. 


Finally, departments need to develop pro- 
cedures for assessing teaching in general, 
and interpreting evaluation data in 
particular, which are described and artic- 
ulated in such a way as to be understandable 
and debatable. It seems that if we are 
ever going to make reasonable and respon- 
sible decisions about teaching, to give 

its appropriate place in the priorities 

and reward structure of the university, we 
must begin to develop procedures which are 
clear and open. They must be reasoned and 
fair, with each professor aware of the pro- 
cess and having had an opportunity to 
contribute to and modify the procedures. 
The last thing we want or need is for 
faculty to feel that somehow its assess- 
ment is biased or unreliable, or that 

there is no room for their special skills 
or unique contributions to be recognized 
and assessed. The University in its 
general policies, as well as the depart- 
ments and faculties in their particular 
procedures need to state clearly what 
importance they attach to teaching, and 

how it shall be assessed, recognized and 
rewarded. 
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Our office is available to assist indivi- 
duals, personnel committees, or departments 
in understanding and interpreting 
evaluation data, as well as in developing 
more comprehensive and systematic procedures 
for the recognition and assessment of 
teaching. 


ne rt A ES Re I 


Every vear at abcut this time we begin 
advertising our annual workshop “Improving 
Instructional Effectiveness". This year 

is no exception aid enclosed with this 
newsletter you will find an information 
flyer with a registration form. 


We have received comments from faculty on 
the fact that they never hear what goes 
on and what participants have learned. 

I spoke to four people and here are some 
of their comments on the workshop: 


1) At this Workshop, I was introduced 
to many new teaching techniques. I had 
a first-hand opportunity to discuss the 
attributes of these methods with people 
who had been using them and I had a chance 
to use some of these techniques on the 
other participants. 

During the Workshop, I was a teacher/ 
learner; it was a rewarding and an 
enjoyable experience. 

(Dr. R.H. Pallen, Assoc. Dean, Division 
III, Faculty of Arts and Science) 


2)Reasons for going - an opportunity 

to exchange ideas and feelings with 
others involved in teaching and learning; 
to be able to explore plans and possibili- 
ties for teaching improvement over time 
(1 week) in a non threatening atmosphere; 
to learn about teaching strategies used 
in a variety of different classes. 

- The benefits of a week long workshop - 
a complete change of atmosphere which 
enhanced and facilitated questions and 
discussions about teaching as an activity 
in general: and exchange of a variety of 
assumptions and problems in particular; 
eliminated staleness - reenergized enthu- 
siasm about teaching; learned about my 
own idioscyncratic approach to teaching 
and learning; learned that my new found 
colleagues experienced similar concerns. 
(Beth Ritchie, Centre for Teaching & 
Learning Services, McGill University.) 
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3) I remember this workshop as one of 
the most valuable and stimulating I 
have undergone. It is all too easy to 
accept a comfortable rut of teaching in 
the same old way by shunting aside any 
nagging feelings of dissatisfaction one 
develops about the way courses seem to be 
going. I decided to do something about 
these feelings and signed up for the 
"Improving Instructional Effectiveness" 
workshop at Lacolle. 


There I met colleagues from several 
disciplines and discovered that I was not 
alone with my feeling that teaching should 
be more challenging for me and learning more 
enjoyable for students. Facilitators from 
the Learning Development and Lacolle Offices 
helped us shake old traditional ideas and 
open up to new philosophies of teaching 

and learning. We discovered that a whole 
body of literature had grown up the last 

few years. In the supportive atmosphere 

of the workshop, we talked about and 
experimented with possible learning models 
we had not used before. 


I think my reaction was typical; I returned 
home inspired, informed and ready to teach 
with new enthusiasm. 

(Dr. Mary Lou Squires, Department of Bio. 
Phys. Ed.) 


A many have expressed a desire to 
attend the workshop but have difficulty 
in staying away in residence for a week 
we are experimenting with holding the 
workshop on the Loyola Campus. 


There will be a fee of $25.00 charged to 
Concordia faculty to pay for materials. 
Registration will be limited to 30. 


